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ABSTRACT 


A  structured  questionnaire  was  administered  to  professional 
personnel  in  industrial  and  government  organizations,  asking  the 
subjects  to  rank  eight  information  gathering  methods  according  to 
their  preference  in  given  hypothetical  situations.  The  subjects 
were  then  asked  to  rate  the  methods  on  a  seven  point  scale 
according  to  (a)  ease  of  use  and  (b)  amount  of  information  expected. 
The  subjects  were  divided  into  two  groups  determined  by  their  time 
spent  in  research  or  research  related  activities.  The  groups  were 
designated  "research"  and  "nonresearch" . 

A  statistical  analysis  of  the  data  from  9^  subjects  (52  in  re¬ 
search,  44  in  nonresearch)  showed  that  no  statistically  significant 
differences  were  present  in  either  the  rankings  or  ratings  between 
research  and  nonresearch  personnel.  A  high  significant  correlation 
was  found,  however,  between  the  preference  ranking  and  the  ease  of 
use  rating  within  both  groups,  whereas  no  signif leant  correlation 
was  found  between  the  preference  ranking  and  the  amount  of  information 
racings. 

The  results  of  the  study  infer  that  the  ease  of  use  of  an 
information  gathering  method  is  more  important  than  the  amount  of. 
information  expected  for  information  gathering  methods  in  industrial 
and  governmental  environments,  regardless  of  the  research  orientation 


of  the  users. 


INTRODUCTION 


Many  recent  studies  have  attempted  to  Investigate  the  "behavioral 
aspects  of  the  information  gathering  process.  Generally ,  these  studies 
have  developed  an  insight  into  the  ways  "by  which  scientists  obtain 
information,  and  have  developed  the  methodology  for  such  studies.  A 
number  of  studies  have  also  sought  to  determine  the  actual  information 
needs  of  scientists.  Generally  neglected,  however,  are  attempts  to 
discover  (a)  why  Individuals  prefer  certain  methods,  (b)  what  attributes 
of  information  gathering  methods  are  important,  and  (c)  if  the  study  of 
the  information  seeking  process  should  be  restricted  to  research 
scientists.  The  purpose  of  this  study  is  to  investigate  such  questions, 
in  an  attempt  to  make  the  interpretation  of  results  from  information- 
user  studies  more  meaningful. 

Most  efforts  in  the  actual  development  of  information  retrieval 
systems  have  been  based,  either  explicitly  or  implicitly,  on  the 
assumption  that  the  greatest  need  for  improved  availability  of  infor¬ 
mation  exists  among  research  scientists.  Although  differences  exist 
in  the  types  of  information  required  by  different  professions,  it  is 
not  at  all  clear  that  the  basic  principles  underlying  the  development 
of  retrieval  systems  should  be  different  for  different  environments. 

METHOD 

To  obtain  the  data  for  the  investigation,  a  structured  question¬ 
naire  was  administered  to  a  selected  group  of  subjects.  The  question¬ 
naire  was  designed  to  minimize  the  inconvenience  of  the  subjects  while 
extracting  the  necessary  information. 


The  questionnaire  first  asked  the  subject  to  indicate  whether  he 
spent  more  than  fifty  percent  of  his  time  in  research  or  research 
related  activities.  This  question  separated  the  subjects  into  two 
groups:  (a)  "research"  and  (b)  "nonresearch".  All  data  were  analyzed 
between  the  two  groups . 

Part  I  of  the  questionnaire  presented  the  subject  with  three 
hypothetical  situations  which  required  information  and  which  would  be 
likely  to  be  part  of  his  general  experience.  The  situations  presented 
concerned  research  for  a  proposal,  research  for  a  journal  article,  and 
research  on  work  being  done  in  a  particular  field.  The  purpose  of  a 
given  hypothetical  situation  was  to  establish  a  frame  of  reference 
within  which  the  subject  was  asked  to  rank  eight  information  gathering 
methods.  The  same  eight  methods  were  presented  in  each  of  the  hypo¬ 
thetical  situations,  but  in  each  case  rearranged  in  a  different, 
random  order,  minimizing  the  possibility  of  subsequent  questions  being 
influenced  by  previous  ones  (i.e.,  order  effects). 

The  information  gathering  methods  were  selected  from  a  group  of 
methods  which  appeared  in  an  earlier  study  (Rosenberg,  1965)\  From 
a  list  of  twentjMihree  items,  the  most  popular,  on  the  basis  of  choice 
by  the  subjects  of  that  study,  were  selected  end  modified.  The  methods 
were  thus  representative  of  generally  used  information  seeking  techniques. 

Part  IIA  of  the  questionnaire,  listing  the  same  eight  methods  as 
in  Part  I,  asked  the  subject  to  rate  each  method  by  the  criterion  of 
ease  of  use.  The  subject  rated  the  method  on  a  seven  point  scale 
ranging  from  "extremely  simple"  to  "extremely  difficult". 


Similarly  in  Part  IIB,  the  subject  vas  asked  to  rate  the  methods 
by  the  criterion  of  amount  of  information  expected,  rating  the  methods 
from  "very  little"  to  "very  much"  information  expected.  As  in  Part  I, 
the  order  of  presentation  was  randomized.  Part  II  was  prepared  in 
four  sets,  each  set  listing  the  methods  in  a  different  random  order, 
to  minimize  any  possibility  of  order  effects.  A  sample  questionnaire 
appears  as  Appendix  I. 

SELECTION  OF  SUBJECTS 

The  population  from  which  the  sample  was  taken  was  professional 
personnel  employed  by  scientific  organizations.  The  sample  was  more 
specifically  defined  as  persons  holding  at  least  a  bachelors  degree, 
employed  in  organizations  with  interests  in  scientific  research. 

An  attempt  was  made  to  secure  employee  directories  from  which  to 
draw  a  random  sample.  The  cooperating  organizations  indicated,  however 
that  the  release  of  such  directories  was  against  corporate  policy,  so 
that  an  alternative  sampling  procedure  was  used.  Six  organizations 
cooperated  in  the  project,  and  in  each  case  a  quantity  of  questionaire1 
was  sent  to  a  cooperating  individual,  who  was  instructed  to  distribute 
the  questionnaire  to  professionals  in  his  organization  representing 
as  many  departments  as  possible.  The  questionnaires  were  returned  by 
mail. 

The  cooperating  organizations  were:  International  Business  Machin 
Corporation,  Research  Division,  San  Jose,  California;  International 
Business  Machines  Corporation,  Thomas  J.  Watson  Research  Center, 


Yorktovn  Heights,  Nev  York;  Merck  and  Company,  West  Point,  Pennsylvania; 
Arthur  D.  Little,  Inc.,  Cambridge,  Massachusetts;  Air  Products  and 
Chemicals,  Inc.,  Allentown,  Pennsylvania;  and  the  United  States  Naval 
Air  Turbine  Test  Station,  Trenton,  New  Jersey.  The  choice  of  co¬ 
operating  organizations  was  dictated  only  by  the  effort  to  obtain 
approximately  equal  numbers  of  subjects  for  both  the  research  and  non- 
research  categories.  Within  the  limited  objectives  of  the  study,  the 
sample  was  suff iciently  diverse  to  eliminate  any  obvious  bias. 

RESULTS 

The  entire  distribution  of  the  questionnaire  to  the  six  cooperating 
organizations  totalled  175.  One  hundred  and  six  questionnaires  were 
completed  and  returned.  Eleven  percent  (12)  of  the  returned  question¬ 
naires  were  rejected  because  certain  parts  of  the  questionnaire  were 
incorrectly  or  incompletely  filled  out.  Table  1.  shows  the  distribution 
statistics  for  the  questionnaire.  Since  no  due  date  was  given  to  the 
subjects,  some  of  the  questionnaires  were  returned  after  the  completion 
of  the  analysis  and  therefore  were  not  included  in  the  sample. 

Total  No.  returned  No.  returned 

questionnaires  correct  reject 

175  94  12 

Table  1.  Distribution  Data 

The  subjects  were  divided  into  the  "research"  and  "nonresearch" 
categories  on  the  basis  of  question  number  one.  The  resulting  set  of 
usable  questionnaires  contained  52  (55  percent)  in  the  research  category 


nnfl  44  (45  percent)  in  the  nonresearch  category. 

The  data  resulting  from  Part  I  of  the  study  consisted  of  sets 
of  ranked  items  for  each  of  the  three  hypothetical  situations, 
listed  in  the  data  as  questions  (Table  2) .  Thus  for  each  group  of 


No.l.  You  are  working  on  a  design  for  a  procedure  or  experiment 
and  wish  to  know  if  similar  work  has  been  done  or  is 
currently  being  done  by  someone  else. 

No .2.  You  are  preparing  a  proposal  for  a  new  project  either  to 

the  management  of  your  organization  or  to  an  outside  agency. 

You  wish  to  substantiate  the  proposal  with  a  thorough 
bibliography.  The  proposal  involves  approximately  $60,000. 

No. 3.  You  wish  to  gather  information  in  order  to  write  an  article 
in  your  area  of  specialization  for  a  trade  or  research 
journal. 

Table  2.  Hypothetical  situations  listed  as  questions. 

subjects  there  were  three  sets  of  ranks  and  the.  degree  of  consistency 
in  the  ranking  was  measured  within  each  group,  for  each  question 
separately  and  averaged  for  the  set  of  all  three  taken  together. 

The  data  for  Part  I  is  tabulated  in  Appendix  II. 

To  measure  the  consistency  of  ranking  among  subjects,  the  Kendall 
coefficient  of  concordance,  W,  was  used.  The  test  ascertains  the 
overall  agreement  amring  k  sets  of  rankings  (i.e.  the  association  among 
them) .  If  there  were  perfect  agreement  among  the  subjects  In  their 
ranking,  each  method  would  have  the  same  rank  for  each  subject.  The 
Kendall  coefficient  of  concordance  is  an  approximate  index  of  the 
divergence  of  the  actual  agreement  shown  in  the  data  from  the  maximum 

p 

possible  (perfect)  agreement. 


Computing  W  for  each  question  in  a  given  group. 


W  =  - § - 

1/12  K2(N3  -  N) 

where 

s  =  sum  of  squares  of  the  observed  deviations  from  the  mean 
of  the  totals  Rj, 

thus, 

•-  IlOj-fj)2 

N 

k  =  number  of  sets  of  rankings ,  i.e.  the  number  of  subjects 
N  -  number  of  items  ranked 

and  the  denominator,  l/l2  k2(N3-N)  is  the  possible  sum  of 

squared  deviations. 

For  the  data  shown  in  Appendix  II,  the  resulting  coefficients 
of  concordance  are  shown  in  Table  3.- 


Question 


Group 

k 

no.l 

no. 2 

Average 

Research 

52 

0.452 

0.5H 

0.539 

0.501 

Nonresearch 

44 

0.326 

0.352 

0.469 

0.382 

Table  3.  Kendall  W  for  Part  I 

The  statistic,  W,  is  linearly  related  to  the  "X  2  (chi-square) 
by  the  formula: 

y2  =  k(N— ljW 

p 

The  statistic  is  used  to  test  the  statistical  significance  of  W. 


In  the  resulting  chi-square  table  (Table  4)  all  entries  are  significant 
at  the  0.05  level. 


Question 


Group 

k 

no.l 

Research 

52 

164.528 

Nonresearch 

44 

100.408 

Table 


no. 2  no. 3  d.f . 

186.004  196.196  7 

108.416  144.452  7 

^*for  Part  I 


The  correlation  between  the  rankings  of  the  two  groups  was  measured 
by  applying  the  Spearman  rank  correlation  coefficient:  rB  to  the  ranks 
of  the  totals  of  each  method  for  each  question  and  for  the  totals  over 
the  three  questions,  Kendall ^  claims  that  the  best  estimate  of  the 
ranking  of  N  items  is  the  ranking  of  the  sums  of  the  various  rankings, 
provided  W  is  significant.  The  ranks  of  the  various  sums  (Table  5) 
are  used  to  find  rs. 


Questions 

$2  ^3  totals 

Methods  R  NR  R  NR  R  NR  R  HR 

1 
2 

3 

4 

5 

6 

7 

8 

Note:  R  =  research,  NR -nonresearch 


1 

2 

8 

6 

5 

3 
7 

4 


4 
2 
8 
6 

5 
l 

7 

3 


2 

1 

8 

4.5 

3 

4.5 

7 

6 


3 

1 

8 

6 

4.5 

2 

7 

4.5 


1 

2 

8 

5 
4 

3 

7 

6 


1 

2 

8 

6 

4 
3 
7 

5 


1 

2 

8 

5. 

4 

3 

7 

6 


1.5 

1.5 

8 

6 

5 

3 
7 

4 


Table  5.  Ranks  of  totals 


The  methods  are  listed  by  numbers  which  are  interpreted  in 
Table  6.  The  fractional  rankings  represent  ties  which  are  averaged 
for  the  computation. 


The  numbering  of  information  gathering  methods  in  the  text  corresponds 
to  the  following  listing: 

Methods 

No.  1  Search  your  personal  library.  1 

No.  2  Search  material  in  the  same  building  where  you  work, 
excluding  your  personal  library,  jj  |.' 

No.  3  Visit  a  knowledgeable  person  —  20  miles  away  or  more. 

No.  4  Use  a  library  that  is  not  within  your  organization. 

No.  5  Consult  a  reference  librarian. 

No.  6  Visit  a  knowledgeable  person  nearby  (within  your 
organization) . 

No.  7  Write  a  letter  requesting  information  from  a  knowledgeable 
person  —  20  miles  away  or  more. 

No.  8  Telephone  a  knowledgeable  person  who  may  be  of  help. 

Table  6.  Numbering  of  methods. 


The  statistic,  rg,  is  calculated  by  the  formula: 

n 

c  H  d2 

6  i=l  ^ 


a  1  “ 


N- 


N 


where 


and 


dj_  =  the  deviation  between  two  ranks 


N  =  number  of  items  ranked 


For  the  data  shown  the  rB  in  each  case  is  significant  at  the  0.05 
level. 

Question 


no.l 

no. 2 

no  r3 

totals 

rs  = 

0.833 

0.786 

0.976 

0.923 

Table  7. 

rB  between  groups 

The  statistic  r„  is  a  one  tailed  test  showing  that  a  significant 

relationship  exists  in  the  data.  It  is  a  nonparametric  test  having 

4 

an  efficiency  of  91  percent  when  compared  to  the  Pearson  r. 

The  data  in  Part  II  of  the  questionnaire  were  ratings  given  to 
each  method  on  the  criteria  (a)  ease  of  use  and  (b)  amount  of 
information.  The  data  for  Part  II  are  tabulated  in  Appendix  III 
and  the  methods  are  referred  to  by  numbers  as  listed  in  Table  6. 

For  the  data  of  the  "ease  of  use"  ratings  the  null  hypothesis 
was  that  no  difference  existed  in  the  mean  ratings  given  the  methods 
by  the  two  groups  (i.e.  HQ  :  g  -ytf- NR  for  all  methods) .  The 
null  hypothesis  was  tested  using  standard  t  tests  corrected  by 
Sheffe’s  method,  which  is  the  most  conservative  of  the  generally  used 
procedures  for  correcting  critical  values  when  a  number  of  t  tests  are 
used, 5  The  results  of  the  t  tests  for  the  "ease  of  use"  ratings  are 
shown  in  Table  8.  The  t  tests  were  calculated  by  the  conputational 

Methods  .  . 

No.l  No  .2  No. 3  No. 4-  No. 5  No. 6  No. 7  No.8 

t  =  .780  >34  .752  .419  .362  .375  .507  .792 

Table  8.  t  tests  for  ease  of  use  ratings. 


formulae: 


6 


vhere: 


2  (na  -  nb  -  2)(nby;xa  -  QeXXb) 

W  22  . . . . .  - .11-  II.  .  — —— — — . — - 

(fta  ~  —  ne,Lb) 

^aa  %  X^  —  (  £• 


^  =  “bIV  (£xb)2 

and 


rig,  =  sample  size  for  group  1 
*s  sample  size  for  group  2 

and  Xg  & 

None  of  the  results  of  the  t  test  are  significant  at  the  0.05  level. 

A  similar  analysis  was  performed  on  the  data  from  Part  IXB,  the 
"amount  of  information"  ratings.  The  results  of  the  t  test  for  these 
data  (Table  9)  again  show  no  significant  difference  at  the  0.05  level. 


Xj^  are  the  scores. 


Methods 

No.l  No  .2  No. 3  No  .4  No. 5  No  .6  No. 7  No  .8 

t  =  .713  .989  .754  1.007  .587  .548  .398  .596 

Table  9.  t  tests  for  amount  of  information  ratings 

The  results  from  Parts  I  and  II  were  then  compared  by  finding 
correlation  coefficients  between  the  sets  of  ranks  and  the  sets  of 
ratings  for  each  group.  To  find  the  correlation  coefficients  a  ranking 
was  derived  from  the  average  ratings  of  the  methods  in  each  case  and 
compared  to  the  ranks  given  by  the  subjects  (Table  10) .  The  Spearman 


Research 


Method  Hc.l  No.2  No. 3  No.4  No. 5  No.6  No. 7  No. 8 

Subject  Ranking  1  2  8  5  4  3  7  6 

Derived  Ease  of  1  2  8  6  5  4  7  3 

Use  Ranking 

Derived  Amount  of  37684512 
Information 
Ranking 

Nonresearch 

Method  No.l  No.2  No. 3  No.4  No  .5  No.6  No. 7  No. 8 

Subject  Ranking  1.5  1.5  8  6  5,3  7  4 

Derived  Ease  of  1  3  8  7-5  4  6  2 

Use  Ranking  t  I  i 

Derived  Amount  of  1  7  5  *  6  3  [  '  8  2  4 

Information 
Ranking 

.  Table  10.  Derived  Rankings 


rank  correlation  coefficient  was  used  for  this  test  (Table  11) .  The 
correlation  of  the  ranks  derived  from  the  ease  of  use  ratings  to  the 


Derived  Rankings  Subject  Rankings 

from  Research  'i  Nonresearch 

Ease  of  Use  0.868  <  '  O.887 

Amount  of  Information  -0.166  -0.113 

Table  11.  Spearman  Rank  Correlation  Coefficients 


subject  rankings  vere  significant  for  both  research  and  nonresearch 
groups,  vhile  the  correlation  of  the  ranks  derived  from  the  amount  of 
information  ratings  to  the  subject  ranking  vere  not  significant  for 
either  group.  Significance  was  determined  at  the  0.05  level  in  all 


cases 


INTERPRETATION  OF  KESUITS: 


The  initial  test  determining  the  degree  of  agreement  among  the 
subjects  in  the  ranking  of  the  methods  shoved  that  the  subjects 
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applied  essentially  the  same  standard  in  ranking  the  eight  methods . 
The  ranking  of  the  totals  for  each  group  can  be  taken  as  the  best 
estimate  of  the  ranking  based  on  the  given  data.  The  significance  of 
the  statistic,  W,  is  not  interpreted  to  mean  that  the  estimated 
rankings  are  correct  by  an  external  criterion,  but  rather  that  they 
are  the  best  estimate  for  the  given  data.  The  fact  that  W  was 
significant  in  all  cases  vas  considered  important  because  the  sub¬ 
sequent  analysis  vas  based  on  the  reliability  of  the  rankings  of  the 
totals . 

The  comparison  of  the  estimated  rankings  for  the  two  groups 
vising  the  Spearman  test  shoved  that  there  van  no  significant  differ¬ 
ence  between  the  two  groups  in  the  rankings.  The  null  hypothesis 
vas,  Hq  :  The  ranks  are  identical.  The  net  result  of  the  first  two 
tests  vas  that  the  tvo  groups  used  essentially  the  same  criterion 
within  the  groups  for  ranking  the  items  and  that,  on  the  basis  of  the 
test,  there  vas  essentially  no  difference  between  the  tvo  groups  in 
the  resulting  rankings. 

For  the  data  in  Part  II,  t  tests  were  applied  to  test  for 
significant  differences  in  the  mean  ratings  on  a  given  method  between 
the  tvo  groups.  The  null  hypothesis  for  comparison  of  the  tvo  means 
on  a  given  rating  of  a  method  vas  HQ  :  /t  R  =  )i .  Since  no  difference 
vas  found  to  be  significant  on  the  basis  of  the  data,  it  vas  inferred 
that  no  meaningful  differences  existed  betveen  the  average  ratings  of 


the  group  (i.e.  for  each  method,  both  groups  gave  the  same  average 
rating).  This  shovs  that,  given  a  set  of  methods,  both  groups  gave 
essentially  the  same  response  in  each  case  when  asked  to  rate  the 
methods  according  to  ease  of  use  and  amount  of  information  expected. 

To  test  the  correlation  between  the  results  of  Part  I  and  the 
results  of  Part  II,  the  ratings  of  Part  II  were  converted  to  ranks 
by  ranking  the  mean  ratings.  Since  the  rankings  of  Part  I  were 
on  an  ordinal  scale,  the  inferences  about  the  correlation  of  the 
data  was  kept  at  the  ordinal  level.  Thus  the  inferences  say  nothing 
about  the  relative  magnitude  of  the  ratings,  but  only  about  their 

Q 

rank.  The  results  of  this  analysis  showed  a  marked  correlation 
between  the  ease  of  use  ratings  and  the  subject  rankings  for  both 
research  and  nonresearch,  and  a  marked  lack  of  correlation  between 
the  amount  of  information  ratings  and  the  subject  rankings. 

The  statistic  used  to  test  the  correlation,  r6,  ranges  frcm 
4-1  to  —1.  A  value  for  rs  of  +1  corresponds  to  perfect  agreement, 
and  a  value  of  —1  corresponds  to  "perfect"  inverse  agreement  (i.e. 
the  highest  subject  ranked  Item  has  the  lowest  derived  rank,  etc.). 
Thus  values  close  to  +1  reflect  a  high  degree  of  agreement  between 
the  two  variables,  whereas  a  value  closi  to  zero  represents  random¬ 
ness  or  lack  of  agreement.  On  the  basis  of  this  statistic,  it  is 
clear  that  the  subjects  preference  ranking  was  far  more  closely 
related  to  his  evaluation  of  the  method’s  ease  of  use  than  to  his 
„ evaluation  of  amount  of  information  expected.  Alternatively,  a 
subject’s  preference  for  a  method  of  getting  information  is  more 
likely  to  correspond  to  his  estimation  of  the  method’s  ease  of  use 


than  his  estimation  of  amount  of  information  expected.  This  inference 
holds  for  both  research  and  nonrese&rch  personnel. 

The  actual  methods  listed  in  the  questionnaire  and  the  hypothetical 
situations  which  served  as  a  framework  for  the  rankings  and  in  some 
sense  for  the  rating  also,  played  a  relatively  minor  part  in  the  study. 

No  attempt  was  made  to  make  inferences  about  the  methods  themselves 
except  that  one  was  ranked  or  rated  above  another.  Thus  the  hypothetical 
situations  and  methods  themselves  served  only  to  gather  data  about  the 
relationships  between  the  two  groups  of  subjects  and  between  the  ratings 
and  the  rankings.  The  interest  in  the  relationships  between  the  sets 
of  data  exclusively  served  as  a  justification  for  the  use  of  the 
structure j.  questionnaire.  No  attempt  was  marie  to  discover  (a)  what  a 
subject  felt  he  would  actually  do,  or  (b)  what  a  subject  actually  does 
in  the  given  situations .  Such  observations  have  been  reported  in  what 
are  generally  known  a3  information  user  studies,  some  of  which  are 
listed  in  the  bibliography. 

A  significant  limitation  of  the  procedure  used  in  the  investigation 
was  that  there  was  no  way  of  validating  the  questionnaire  to  test  its 
sensitivity  to  the  variables  to  be  measured.  General  procedure  re¬ 
quires  the  test  to  be  administered  to  samples  where  differences  in 
the  tested  variable  are  known  to  exist  to  determine  the  sensitivity  of 
the  test  to  the  variable  in  question.  Since  the  experimental  hypothesis 
was  that  no  differences  existed  between  the  two  groups  tested,  no 
population  could  be  found  where  differences  were  known  to  exist.  The 
consistency  of  the  data  and  the  significance  of  the  tests,  however. 


imply  that  the  testing  procedure  vas  valid.  The  similarity  of  the 
results  to  the  results  of  studies  observing  actual  behavior  also 
provides  support  for  the  validity  of  the  experimental  procedure. 


DISCUSSION: 

Although  much  research  has  been  done  to  study  the  Information 
gathering  behavior  of  professional  personnel,  very  little  has  been 
done  to  establish  the  reasons  for  the  observed  behavior.  The  relative 
priority  of  the  most  frequently  used  channels  has  been  established  by 
almost  all  studies,  and  in  almost  every  case,  the  analysis  has  shown 
that  one  of  the  most  significant  factors  in  determining  the  priority 
is  the  availability  of  the  source .  The  implication  is  that  the 
information  gathering  behavior  of  users  is  dictated  primarily  by  the 
facilities  available  and  changes  to  reflect  a  change  in  the  availabilitj 
of  facilities.  The  importance  of  availability  of  information  is  con¬ 
sistent  with  the  results  of  the  present  study  and  implies  that  the 
primary  attribute  of  any  information  gathering  method  is  its  ease  of 
use  .9 

Although  the  methods  listed  in  the  study  were  only  secondarily 
important,  the  overall  preference  listing  of  the  methods  shows  an 
interesting  correlation  to  a  study  where  actual  performance  was  measured 
In  a  study  investigating  the  utilization  of  information  sources  in  re¬ 
search  and  development  proposal  preparation  (Allen,  1964) ,  information 
sources  were  divided  into  three  categories:  (a)  literature  search; 

(b)  consulting  with  laboratory  specialists;  and  (c)  consulting  with  out¬ 
side  sources.  The  data  from  the  study  show,  among  other  things  that  the 


mean  times  spent  in  each  activity  were:  (a)  28.4  man  hours;  (b)  17.2 
mem  hours;  and  (c)  11.6  mem  hours,  respectively.  If  one  divides  the 
information  gathering  methods  of  the  present  study  in  a  similar 
manner  (Table  12) ,  there  seems  to  be  a  one  to  one  relationship  between 
the  preference  rankings  given  and  the  results  of  Allen's  study,  if 
preference  can  be  equated  with  time  spent.10 


Method 


Overall 
Average  Rank 


Allen's 

Category 


Search  your  personal  library. 


Search  the  material  in  the 
same  building  where  you 
work, excluding  your 
personal  library. 


Literature 

Search 


Visit  a  knowledgeable  person 
nearby  (within  your 
organization)  3 


Consult  a  reference  librarian.  4 


Consulting 
with  Lab. 
Specialists 


Write  a  letter  requesting 
information  from  a 
knowledgeable  person  — 

20  miles  away  or  more. 

Visit  a  knowledgeable  person 
—  20  miles  away  or  more. 


V  Consulting 
8  J  Outside 
J  Specialists 


Average 

Man-Hours 


28.4 


17.2 


11.6 


Note:  Two  of  the  methods  were  not  decidable  (Nos.  4  and  8). 


Table  12.  Comparison  of  two  studies 


The  comparison  of  the  two  studies  shows  that  there  is  substantial 
agreement  between  the  results  of  the  present  study  giving  the  subject's 


3 


opinion  of  preference  and  Allen’s  study  showing  actual  performance. 

Such  agreement  combined  with  the  general  inference  of  user  studies 
concerning  the  importance  of  availability  can  be  considered  a  sub¬ 
stantiation  of  the  validity  of  the  present  study. 

It  may  also  be  inferred  from  the  agreement  between  the  two 
studies  that  asking  the  subject  for  opinions  concerning  information 
gathering  behavior  yields  data  as  meaningful  as  the  data  from  obser¬ 
vation  studies,  provided  the  sample  is  sufficiently  large.  Since 
observation  studies  are  more  complex  and  difficult  to  control,  the  use 
of  structured  questionnaires  requesting  opinions  could  greatly  simplify 
and  thereby  expand  the  scope  of  Btudies  investigating  information 
gathering  behavior . 

The  scope  of  the  study  was  limited  to  professional  personnel  in 
government  and  industrial  organizations.  The  inferences  of  the  study 
are  assumed  to  hold  only  for  this  population.  Hanson  (1964),  in  a 
study  of  information  seeking  behavior  found  that  industrial  and  govern¬ 
ment  personnel  differed  from  those  in  academic  institutions  in  a  number 
of  ways.  He  found  the  organizational  differences  more  pronounced  than 
the  differences  across  disciplines. 

...we  find  that  the  differences  in  needs  and 
demands  for  information  associated  with  the 
kind  of  employment  are  on  the  whole  greater 
than  those  associated  with  discipline.  That 
is  to  say,  although  there  are  differences 
between  scientists  and  engineers  as  such,  and 
between  for  instance  physicists  and  chemists, 
these  are  less  marked  than  the  differences  be¬ 
tween  people,  irrespective  of  discipline, 
working  in  industry  and  those  working  in,  say, 
academic  institutions.  Comparing  these  last 
two  we  find  that  people  working  in  industry 


wanted  information  more  quickly  than  the 
academics-  ...  In  most  respects  people 
working  in  Government  establishments  be¬ 
haved  in  much  the  same  way  (as  those  in 
industry)  .3J- 

Hanson’s  study  seems  to  substantiate  the  result  that  fever 
significant  differences  exist  between  professional,  disciplines  within 
industry  and  government  organizations  than  between  types  of  institutions 
and  that  the  professionals  are  primarily  concerned  with  the  ease  of 
obtaining  information. 

CONCLUSIONS: 

From  the  results  of  the  experiment,  it  is  reasonable  to  conclude 
that:  (a)  research  and  nonresearch  professional  personnel  in  industry 
or  government  do  not  differ  to  any  appreciable  extent  in  their  evaluation 
of  information  gathering  methods;  and  (b)  the  preference  for  a  given 
method  reflects  the  estimated  ease  of  use  of  the  method  rather  than  the 
amount  of  information  expected.  These  conclusions  in  conjunction  with 
the  results  of  observation  studies  imply  further  that  the  basic  parameter 
for  the  design  of  any  industrial  information  system  should  be  the  system’s 
ease  of  use,  rather  than  the  amount  of  information  provided,  and  that  if 
an  organization  desires  to  have  a  high  quality  of  information  used,  it 
must  make  ease  of  access  of  primary  importance. 

Since  the  optimization  of  all  variables  has  not  yet  beccane  a 
practical  reality,  the  design  of  an  actual  system  usually  permits  the 
optimization  of  some  parameters  only  at  the  expense  of  others.  If  all 
other  variables  such  as  cost,  environment,  etc.,  are  held  constant,  a 
system  can  be  designed  to  provide  a  maximum  amount  of  information  at  the 


expense  of  effort,  or  It  can  be  designed  to  minimize  effort  at  the 
expense  of  information  yield.  Cast  in  the  terms  of  information 
retrieval,  one  can  maximize  either  recall  or  precision.  In  industrial 
environments,  the  design  criteria  should  lean  toward  the  minimization 
of  effort  (i.e.  precision). 

A  secondary  conclusion,  supported  by  the  correlation  of  the  resulti 
with  observation  studies,  is  that  user  surveys  can  be  accomplished  by 
the  use  of  a  veil  designed  structured  questionnaire  technique,  without 
resorting  to  direct  observation,  if  the  sample  is  large  enough.  The 
questionnaire  technique  is  far  more  efficient  and  less  expensive  than 
observation  surveys. 

On  the  basis  of  the  present  study,  it  appears  that  further  re¬ 
search  using  similar  techniques  could  accurately  identify  the  relation¬ 
ship  of  information  system  characteristics  to  the  system  environment. 
Such  further  research  might,  for  example,  examine  the  relationships 
between  academic  and  industrial  environments.  A  further  examination 
of  the  factors  involved  in  the  concept  "ease  of  use",  (e.g.  time, 
distance,  or  intellectual  effort) ,  should  also  prove  useful  in  providin 
a  more  detailed  description  of  the  information  gathering  process  and 
system  environments. 


Appendix  I 


The  Questionnaire 


Questionnaire 


This  is  a  questionnaire  which  seeks  to  determine  your  evalua¬ 
tion  of  various  methods  of  gathering  information.  There  are  three 
hypothetical  problems  which  you  might  encounter  in  your  work.  Be¬ 
low  -h  hypothetical  problem  are  various  methods  for  gathering  the 
information  necessary  for  the  solution  of  the  problem.  You  are 
asked,  in  Part  I,  to  rank  all  the  items  as  to  their  usefulness  in 
the  given  situation  and  then,  in  Part  H,  to  evaluate  each  item  as 
to  the  amount  of  information  it  will  provide  and  as  to  the  method^ 
ease  of  use.  These  are  relative  judgements  and  are  made  by  check¬ 
ing  the  appropriate  number  on  the  seven  point  scale. 

If  you  would  be  interested  in  a  summary  of  the  results  of  the 
questionnaire,  place  your  name  and  address  below. 

Thank  you  for  your  cooperation. 


V.  Rosenberg 

Center  for  the 

Information  Sciences 

Lehigh  University 

Bethlehem,  Pennsylvania  18015 


Question  No.  1 

Do  you  spend  more  than  50%  of  your  time  in  what  you  consider 
research  or  research  related  activities? 


- Yes 


No 


Hypothetical  Situation  No.  1 


You  are  working  on  a  design  for  a  procedure  or  experiment  and 
wish  to  know  if  similar  work  has  been  done  or  is  currently  being 
done  by  someone  else. 

Please  rank  the  methods  listed  below  according  to  your  prefer¬ 
ence  for  getting  the  required  information.  No.  1  for  most  useful, 
etc. 


Search  your  personal  library. 

Search  material  in  the  same  building  where  you  work,  excluding 
your  personal  library. 

Visit  a  knowledgeable  person  -  20  miles  away  or  more. 

Use  a  library  that  is  not  within  your  organization. 

Consult  a  reference  librarian. 


Visit  a  knowledgeable  person  nearby  (within  your  organiza¬ 
tion.)  (|  I 

Write  a  letter  requesting;  information  from  a  knowledgeable 
person  -  20  miles  away  or  more. 


Telephone  a  knowledgeable  person  who  may  be  of  help. 


Hypothetical  Situation  No.  2 


You  are  preparing  a  proposal  for  a  new  project  either  to  the 
management  of  your  organization  or  to  an  outside  agency.  You  wish 
to  substantiate  the  proposal  with  a  thorough  bibliography.  The 
proposal  involves  approximately  $60,000. 

Please  rank  these  ’’methods"  according  to  their  usefulness  in 
this  situation. 


Telephone  a  knowledgeable  person  who  may  be  of  help. 
Consult  a  reference  librarian. 


Use  a  library  that  is  not  within  your  organization. 


Search  material  in  the  same  building  where  you  work,  excluding 
your  personal  library. 


Visit  a  knowledgeable  person  nearby  (within  your  organiza¬ 
tion.) 


Search  your  personal  library. 


Visit  a  knowledgeable  person  -  20  miles  away  or  more. 


Write  a  letter  requesting  information  from  a  knowledgeable 
person  -  20  miles  away  or  more. 
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-  4  - 

Hypothetical  Situation  No.  3 

You  wish  to  gather  information  in  order  to  write  an  article 
in  your  area  of  specialization  for  a  trade  or  research  journal. 

Again  please  rank  the  "methods”  listed  below. 


Visit  a  knowledgeable  person  nearby  (within  your  organiza¬ 
tion.) 


_  Visit  a  knowledgeable  person  -  20  miles  away  or  more. 

_  Search  material  in  the  same  building  where  you  work,  excluding 

your  personal  library. 

_  Search  your  personal  library. 

_  Telephone  a  knowledgeable  person  who  may  be  of  help. 

. . . —  Write  a  letter  requesting  information  from  a  knowledgeable 

person  -  20  miles  away  or  more. 

_  Consult  a  reference  librarian. 


Use  a  library  that  is  not  within  your  organization. 


5 


Part  IIA 


Please  rata  each  of  the  information  gathering  methods,  as  listed 
below,  according  to  the  criteria  indicated  by  circling  the  appropriate 
number  on  the  seven  point  scale. 

Please  give  these  ratings  without  referring  back  to  Part  I. 


1.  Visit  a  knowledgeable  person  -  20  miles  away  or  more. 


extremely 

simple 

ERSE  OF  USE 

1 

2  3  4 

S 

6 

»| 

2.  Search  your  personal  library. 

extremely  i 
simple 

ERSE  OF  USE 

. 

!_i _ 

2  3  4! 

5 

6 

7| 

3.  Use  a  library  that 

|!  ■ 

is  riot  within  your  organization 

• 

extremely  r 
simple  | 

ERSE  OF  USE 

! 

i 

2  3  4  |« 

i 

> 

6 

_ zJ 

extremely 

difficult 


extremely 

difficult 


extremely 

difficult 


4.  Visit  a  knowledgeable  person  nearby  (within  your  organization) 

_  ERSE  OF  USE 


extremely 

simple 


7  extremely 
difficult 
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Part  IIB 


-  7 


Please  rate  each  of  the  information  gathering  methods,  as  listed 
below,  according  to  the  criteria  indicated  by  circling  the  appropriate 
number  on  the  seven  point  scale. 

Please  give  these  ratings  without  referring  back  to  Part  I. 
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Part  IIB  (Cont’d.) 


7.  Search  material  in  the  building  where  you  work,  excluding  your 


very  little 


AMOUNT  OF  INFORMATION  EXPECTED 


very  much 


Appendix  II 


Data  for  Part  I 


SUB.NO 


QUEST 


Mtl]  M[2]  M[3] 


100 

101 

102 

103 

104 

105 

106 

107 

108 
109 
no 
in 
112 
H3 
n4 
H5 

116 

117 
n8 

119 

120 
121 
122 

123 

124 
025 
126 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

160 

161 

180 

181 

182 

183 

184 

185 
•  186 

187 

188 

Totals  - 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


2 

4 

4 
8 

3 

1 

3 

1 

3 

5 
2 
1 
2 
1 
1 
1 
8 
2 
1 
1 
1 
1 

5 

2 

2 

1 

3 
8 
1 
8 
1 
3 
3 
1 

2 
1 
1 
1 
1 
2 
1 

3 

1 

1 

1 

l 

1 

1 

1 

3 

1 

1 

118 


3 

5 

6 

3 

2 

3 

4 
2 
1 
3 

3 

5 
1 
2 

4 
2 
1 

6 
4 
2 
3 
3 
2 
1 
6 

3 

1 

3 

3 

3 

3 

2 

2 

2 

3 

4 
2 

3 

2 

1 

2 

2 

3 

3 

2 

2 

2 

2 

2 

2 

3 

3 

142 


8 

3 

3 

5 
8 

6 
7 
7 

7 

8 
8 
7 

7 

8 
8 

7 
6 

8 
6 
6 
6 
8 
8 
8 
8 

7 

8 
6 
8 

5 
8 

4 

7 

8 

4 

6 
7 

7 
6 

8 

7 

8 

5 

6 
8 

7 

8 

5 

7 

8 

7 

8 


354 


M[4]  Mt5l  M[6]  M[7]  M[8] 


5 

6 

5 

4 

6 

5 

6 
8 
6 
6 
6 

3 

4 
6 

5 

6 
2 
5 
5 

3 

4 

5 

3 
5 

7 

8 
2 
5 

7 

4 

5 
1 

4 

6 
1 

5 

6 

8 

4 

3 

6 

5 
7 
7 
7 

3 

5 
7 

4 
4 

6 
6 


262 


7 

7 

8 
6 
1 
8 

5 

4 

8 

4 

5 

6 
3 
5 
3 
5 

3 
1 
2 
8 

5 

2 

1 

4 
1 
2 

5 
4 

4 

7 

6 

7 

8 

5 
8 
8 
8 

4 

5 

4 

3 

6 
8 

5 

6 
8 

3 

8 

3 

1 

5 

5 


260 


4 
1 
2 
1 

5 
2 
1 

3 
2 
2 
1 
* 

5 

4 
2 
4 
7 
7 

3 

4 
2 

7 

4 

3 

3 

4 

4 
2 

5 
2 
2 

6 
1 
3 
7 
2 

3 

2 

3 
7 

4 
4 
2 
2 

3 

4 

4 

3 
6 

5 

4 
4 

181 


6 

8 

4 
7 
7 

7 

8 
6 

5 

7 
4 

6 

8 
7 

7 

8 

4 

3 
7 

7 

8 
6 
7 
7 

5 

6 
6 

7 

6 

6 

7 

8 
6 
7 
5 

7 

5 

6 

8 

5 
8 

7 

6 

8 

4 
6 

7 
6 

8 

7 

8 

7 


1 

2 

1 

2 

4 

4 
2 

5 

4 

7 

7 
2 

6 

3 

6 

3 

5 

4 

8 

5 
7 
4 

6 
6 

4 

5 
7 

1 

2 
1 

4 

5 

5 
4 

6 

3 

4 

5 
7 

6 

5 

1 

4 

4 

5 

5 

6 

4 

5 

6 
2 
2 


336  216 


Table  13.  Research  Personnel  —  Question  No.l  (Data) 


6UB.N0 


QUEST 


100 

101 

102 

103 

104 

105 

106 

107 

108 
109 

no 

in 

112 

113 

n4 

115 

n6 

117 

n8 

119 

120 
121 
122 
123 

124 

125 

126 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

160 

161 

180 

181 
182 

183 

184 

185 

186 

187 

188 

Totals  = 


.  M[1]  M[2]  Mt3l  M[4]  MC5]  m  16}  M[7]  m[8] 


2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

z 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

8 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 


Table  14 


1 

1 

8 

3 

1 

1 

5 

2 

8 

3 

Z 

3 
1 
1 
1 
1 
8 
2 
1 
1 
1 
1 

5 

4 
2 
1 

3 
8 
1 
8 
1 

4 

3 

1 

3 

2 

3 

1 

1 

2 

3 

5 
2 
1 
2 
1 
1 
1 
1 
2 
1 
3 

132 


4 

2 

7 

1 

3 

2 
2 
1 
1 
2 

3 

4 
2 
2 
2 
2 
1 
6 

5 
2 
2 

3 

2 

1 

3 

3 

1 

2 

3 
2 
2 
1 
1 
2 
2 

4 
2 

3 

2 

1 

2 

3 

1 

3 
1 
2 

4 
2 
2 
1 

3 

2 

122 


6 

8 

5 

7 

7 

8 

7 

8 

7 

8 
8 
7 

7 

8 
8 
8 

5 

7 

6 

8 

7 

7 

8 
8 
8 
8 
8 
6 
6 
6 
7 
7 

7 

8 

5 

6 

7 

7 
6 

8 
7 
7 
7 
6 

7 
6 

8 
5 

7 

8 

7 

8 

366 


8 

6 


1 

2 

6 

3 
6 

7 

4 
4 
4 
1 
4 
3 
3 
6 
3 

8 
3 

3 

4 

5 
3 
3 
5 

7 
2 

3 
5 
1 

4 
2 

4 

5 
1 
1 
4 

8 
4 


7 

3 
2 

5 

4 

7 

1 

3 

5 
1 
1 

8 

3 

4 

4 

5 

2 
1 
2 
4 

3 
2 
1 
2 
1 
2 

4 
1 
2 
3 
3 
3 
8 

3 
8 

5 

1 

4 

5 
4 
1 

6 

3 

4 

3 
8 
2 
8 

4 
3 

5 
1 

I85 


2 

4 

3 
6 
2 

4 

3 

4 
2 
6 
6 
2 

5 

6 
6 

4 
7 

5 

4 

5 

5 

6 
6 

5 
4 
4 

6 

4 

4 

5 

6 

5 
2 
4 
4 

3 

6 
2 


5 

7 

4 

8 
8 

6 
8 
6 
6 

7 

5 

5 

8 

7 

7 

7 

6 

4 
7 

7 
6 

8 

7 

6 

7 

6 

6 

7 

7 

7 

8 
8 
6 

7 

6 

7 

5 

6 

8 

7 

8 
8 
6 
8 
8 
7 

7 
6 

8 

7 

8 
7 

351 


.  Research  Personnel  -  Question  No .2  (Data) 


3 

5 

6 

4 

5 
5 

4 

5 
3 

5 

7 

6 
6 
5 

5 

3 

4 

3 

8 

6 
8 

4 

4 

7 

6 

6 

7 

5 

8 

4 

5 

6 

5 

6 

7 

8 
8 

5 
7 

6 
4 


33 


SUB .NO. 

QUEST. 

M[l] 

M[2] 

M(3) 

M[4] 

M[5) 

M(6] 

Mt73 

< 

M[8] 

100 

3 

1 

2 

5 

7 

8 

3 

'6 

4 

101 

3 

1 

2 

8 

6 

4 

5 

7 

3 

102 

3 

2 

3 

7 

1 

8 

6 

5 

4 

103 

3 

2 

1 

8 

7 

4 

5 

6 

3 

104 

3 

1 

5 

7 

3 

2 

6 

8 

4 

105 

3 

3 

2 

7 

5 

8 

1 

6 

4 

106 

3 

5 

4 

8 

6 

2 

1 

7 

3 

107 

3 

1 

2 

8 

4 

3 

5 

7 

6 

108 

3 

1 

2 

8 

4 

6 

7 

5 

109 

3 

5 

1 

8 

7 

2 

6 

3 

4 

110 

3 

1 

3 

8 

6 

4 

0 

7 

5 

111 

3 

3 

4 

7 

2 

8 

1 

6 

5 

112 

3 

1 

2 

6 

4 

3 

5 

8 

7 

113 

3 

1 

2 

8 

5 

3 

6 

7 

4 

n4 

3 

1 

2 

8 

6 

3 

5 

7 

4 

115 

3 

1 

3 

7 

5 

2 

6 

8 

4 

n6 

3 

8 

2 

6 

3 

1 

4 

7 

5 

117 

3 

2 

5 

8 

3 

1 

4 

7 

6 

118 

3 

1 

4 

5 

6 

2 

3 

7 

8 

119 

3 

1 

2 

8 

3 

4 

5 

7 

6 

120 

3 

1 

4 

8 

5 

2 

3 

7 

6 

121 

3 

1 

3 

8 

5 

2 

6 

7 

4 

122 

3 

5 

2 

8 

3 

1 

4 

7 

6 

123 

3 

1 

2 

8 

•3 

5 

4 

7 

6 

124 

3 

2 

3 

8 

5 

1 

4 

7 

6 

125 

3 

1 

7 

6 

8 

2 

3 

4 

5 

126 

3 

3 

1 

8 

2 

5 

4 

6 

7 

135 

3 

8 

1 

6 

5 

2 

3 

7 

4 

136 

3 

1 

2 

6 

8 

4 

5 

7 

3 

137 

3 

8 

2 

5 

1 

3 

4 

7 

6 

138 

3 

1 

2  ** 

7 

4 

5 

3 

8 

6 

139 

3 

1 

2 

5 

3 

7 

4 

8 

6 

l4o 

3 

1 

2 

7 

3 

8 

4 

6 

5 

l4l 

3 

1 

3 

8 

6 

5 

4 

7 

2 

142 

3 

1 

3 

5 

2 

8 

4 

6 

7 

143 

3 

1 

2 

7 

3 

8 

4 

6 

5 

144 

3 

1 

2 

7 

5 

8 

3 

4 

6 

145 

3 

1 

4 

7 

6 

5 

2 

8 

3 

146 

3 

1 

2 

6 

4 

5 

3 

8 

7 

147 

3 

2 

1 

8 

3 

4 

7 

5 

6 

148 

3 

1 

5 

7 

4 

2 

6 

8 

3 

160 

3 

1 

2 

8 

6 

5 

3 

7 

4 

161 

3 

1 

2 

5 

8 

7 

3 

6 

4 

180 

3 

1 

2 

7 

6 

4 

5 

8 

3 

181 

3 

1 

2 

8 

5 

6 

3 

7 

4 

182 

3 

1 

3 

6 

5 

8 

4 

7 

2 

183 

3 

1 

2 

8 

4 

3 

5 

7 

6 

184 

3 

1 

2 

4 

7 

8 

3 

6 

5 

185 

3 

1 

2 

7 

4 

3 

6 

8 

5 

186 

3 

1 

2 

8 

■  4 

3 

5 

7 

6 

.  187 

3 

1 

2 

7 

3 

5 

4 

8 

6 

188 

3 

1 

4 

8 

3 

2 

6 

7 

5 

Totals  = 

96 

133 

366 

236 

224 

213 

351 

253 

Totals  over 

all 

346 

397 

1086 

721 

669 

617 

1038 

739 

Table  15.  Research  Personnel  -  Question  No. 3  (Data) 


SUB.NO. 


QUEST.  MCI]  M[2]  Mt3  ]  M[4]  M[5l  M[6]  M[7]  M[8] 


200 

201 

202 

203 

204 

205 

206 
207 

209 

210 
211 
212 
213 

214 

215 

216 

217 

218 
219 
220 
221 
222 
223 

224 

225 
226 

227 

228 
229 

230 

231 

232 

233 

234 

235 

240 

241 

242 
260 
261 

280 

281 

282 

283 


6 

6 

2 

5 

3 

5 

6 

7 
6 

5 

6 

3 
1 

8 

7 
6 

8 
8 
1 
8 
6 
6 

7 
5 

5 

4 

8 

6 

3 
6 

5 
7 

7 

8 

5 

4 

5 
7 
7 
7 
4 
4 
4 
7 


8 

5 
1 

6 
4 
4 

4 

5 
5 
7 
7 
2 

3 

4 

5 

3 
5 

7 

4 

5 
1 
2 

5 

6 
2 
3 

5 
2 

6 

5 

6 

8 
8 

7 
2 

3 

8 

5 

6 
8 
3 

3 
1 

4 


1 

3 
8 
2 
2 
8 
2 

4 
1 
2 

3 
6 

4 
2 

3 

1 

2 

3 

3 

2 

2 

3 

1 

3 

4 

5 

3 

4 

5 
3 
2 
1 
1 

3 

4 
1 

3 
2 

4 
1 

5 
2 

5 

2 


5 

2 

5 

8 

5 

3 

7 

6 

4 
3 

5 

8 

7 

5 

6 

8 
6 
6 
6 
6 
7 
7 
6 

7 

3 
6 

7 

7 

7 

7 

8 

4 

4 
6 
8 
6 

7 

8 

5 

5 
7 

7 

8 

6 


4 

1 

4 

4 
6 
7 

5 
3 

3 

4 
1 
4 

6 
6 
4 
2 
1 

4 
2 

3 

5 
1 
2 
2 
1 
2 
2 
1 

4 

4 
3 

3 
2 
2 

6 

5 

4 
1 

3 

2 

6 
6 
6 
3 


Totals  = 


155  146  291  244  203  131  264  150 


Table  16.  Non  Research  Personnel  —  Question  No.l  (Data) 


SUB. NO. 

QUEST. 

M[l] 

M[2] 

M[3l 

M[4] 

Mbl 

m[6] 

M(7] 

200 

2 

1 

2 

8 

3 

6 

4 

7 

201 

2 

8 

7 

3 

6 

5 

1 

4 

1 

202 

2 

2 

6 

8 

3 

1 

5 

7 

203 

2 

2 

3 

7 

4 

1 

5 

8 

204 

2 

8 

2 

7 

4 

3 

1 

6 

205 

2 

8 

6 

7 

2 

1 

5 

4 

206 

2 

1 

2 

7 

6 

5 

3 

8 

207 

2 

1 

2 

8 

7 

5 

4 

6 

209 

2 

8 

2 

7 

6 

5 

1 

4 

210 

2 

2 

1 

8 

7 

6 

3 

5 

231 

2 

1 

2 

8 

6 

5 

3 

7 

212 

2 

6 

1 

7 

3 

2 

4 

8 

213 

2 

8 

1 

7 

2 

5 

3 

6 

214 

2 

2 

3 

7 

8 

4 

1 

6 

215 

2 

1 

4 

8 

7 

5 

3 

6 

216 

2 

*  1 

5 

7 

6 

4 

2 

8 

217 

2 

3 

4 

7 

6 

5 

2 

8 

218 

2 

1 

2 

4 

7 

8 

5 

6 

219 

2 

6 

3 

8 

1 

2 

5 

7 

220 

2 

1 

7 

4 

8 

5 

2 

6 

221 

2 

8 

2 

5 

7 

1 

3 

6 

222 

2 

7 

1 

8 

3 

5 

2 

6 

223 

2 

2 

3 

7 

8 

1 

4 

6 

224 

2 

1 

2 

8 

3 

4 

5 

7 

225 

2 

8 

3 

7 

2 

1 

4 

6 

226 

2 

1 

2 

8 

6 

4 

3 

7 

227 

2 

1 

3 

*  7 

6 

5 

4 

8 

228 

2 

7 

1 

5 

6 

3 

4 

8 

229 

2 

2 

3 

8 

l 

4 

6 

7 

230 

2 

1 

3 

8 

6 

5 

4 

7 

231 

2 

3 

1 

5 

7 

8 

2 

1 

6 

232 

2 

5 

l  | 

8 

4 

6 

2 

7 

233 

2 

3 

7 

2 

8 

6 

4  1 

1 

234 

2 

1 

2 

7 

3 

6 

5 

8 

235 

2 

1 

3 

7 

6 

2 

4 

8 

240 

2 

8 

2 

7 

5 

1 

4 

6 

241 

2 

1 

2 

7 

5 

8 

3  i 

6 

242 

2 

1 

3 

7 

4 

2 

5 

8 

260 

2 

1 

2 

7 

6 

3 

5  i 

8 

261 

2 

8 

3 

6 

5 

7 

1 ! 

4 

280 

2 

1 

3 

8 

4 

2 

5: 

7 

281 

2 

7 

3 

8 

2 

1 

k 

6 

282 

2 

4 

3 

6 

2 

1 

5 

8 

283 

2 

1 

4 

8 

7 

5 

2 

6 

Totals  = 

154 

127 

301 

218 

1?4 

152 

284 

m[8] 


174 


Table  17.  Non  Research  Personnel  —  Question  No. 2  (Data) 


uj  — 4  vji  <7\  ro  -p"  on  -p'U)  vji  •p'Njioj-provjirorovjivjiONVji-P'  •P'oj  -P"oj  h  uj  ro  vji  -p-vji  -p"  -p-lo  oj  -p-co  \ji  on  -p-  ro  vji 


SUB.NO.  QUEST.  M[l]  M[2]  M[3]  m[4]  M[5]  m[6]  M[7]  m[8] 


200 

3 

1 

2 

201 

3 

8 

7 

202 

3 

3 

4 

203 

3 

1 

2 

204  , 

3 

1 

2 

205 

3 

1 

2 

206 

3 

1 

2 

207 

3 

1 

2 

209 

3 

8 

2 

210 

3 

1 

2 

211 

3 

1 

2 

212 

3 

4 

1 

213 

3 

1 

2 

214 

3 

2 

4 

215 

3 

1 

2 

216 

3 

1 

2 

217 

3 

3 

4 

218 

3 

1 

2 

219 

3 

1 

8 

220 

3 

1 

7 

221 

3 

4 

3 

222 

3 

3 

2 

223 

3 

1 

5 

224 

3 

1 

2 

225 

3 

2 

6 

226 

3 

3 

4 

227 

3 

1 

3 

228 

3 

2 

1 

229 

3 

1 

2 

230 

3 

3 

1 

231 

3 

4 

3 

232 

3 

3 

2 

233 

3 

3 

4 

234 

3 

1 

2 

235 

3 

1 

3 

240 

3 

1 

2 

24l 

3 

1 

2 

242 

3 

1 

3 

260 

3 

1 

2 

261 

3  . 

4 

3 

280 

3 

1 

2 

281 

3 

2 

3 

28 2 

3 

3 

2 

283 

3 

1 

3 

83547 
36524 
8  12  7  6 

75438 
86537 

7  6  4  3  5 

8  4  5  3  6 

8  6  5  3  7 

7  5  4  1  6 

84357 

7  6  5  3  8 

7  3  2  5  8 

8  3  7  4  6 

587  l  6 
8  4  3  5  7 

7  4  3  5  8 

6  7  5  2  8 

8  3  4  6  7 

62357 

4  8  5  2  6 

7  2  15  8 

5  7  6  1  8 

4  8  7  6  3 

8  5  7*3  6 

78514 
87216 
76528 
64357 

83657 
84257 
62185 
8  7  5  1  6 

28716 

5  7  6  4  8 

7  5  2  4  8 

83457 
7  3  4  5  8 

6  7  5  4  8 

76348 

7  6  81  5 

84357 
61458 
64157 
86247 


Totals  = 

90 

126 

297 

217 

185 

162 

296 

205 

Totals  over  all 

399 

399 

889 

679 

562 

445 

844 

529 

Table  18.  Non  Research  Personnel  -  Question  No. 3  (Data) 


vjiC3-jcr\rovjiroer\o\  o\u>  vji  -p-— j  o\  -f-  cd  ■p-vjj  u>  -p*  ro  ■P'omjj  •P'vji  h  ct\  fo  \ji  -p*  cr»u>  -P'-o  u>  -p*  o\\j>  h  ctn 


Appendix  III 
Data  for  Part  II 


SUB.NO 


m[4]  H[5l 


TYIE  M[l]  M[2]  M[3  3 


M[6]  M[7]  *[8] 


100 

0 

1 

2 

4 

3 

101 

0 

1 

1 

7 

4 

102 

0 

1 

3 

1 

2 

103 

0 

1 

5 

4 

3 

104 

0 

1 

7 

7 

1 

105 

0 

1 

3 

2 

4 

106 

0 

1 

4 

6 

3 

107 

0 

1 

2 

7 

6 

108 

0 

1 

1 

5 

2 

109 

0 

2 

3 

6 

5 

no 

0 

1 

3 

5 

4 

in 

0 

1 

4 

7 

2 

112 

1 

1 

1 

4 

2 

113 

1 

1 

2 

6 

6 

n4 

1 

1 

2 

6 

2 

115 

1 

1 

1 

7 

4 

n6 

1 

1 

1 

4 

3 

n7 

1 

1 

2 

2 

4 

n8 

1 

1 

*2 

3 

1 3 

;a9 

2 

1 

1 

6 

1 

120 

1 

1 

1 

5 

1 

121 

1 

1 

1 

7 

4 

122 

1 

2 

2 

7 

3 

123 

1 

1 

1  . 

5 

3 

124 

1 

2 

2 

7 

5 

125 

1 

1 

4 

3 

4 

126 

0 

1 

1 

5 

1 

135 

1 

1 

1 

4 

2 

136 

1 

1 

4 

6 

4 

137 

1 

1 

2 

4 

<3 

138 

1 

1 

2 

6 

4 

139 

1 

2 

4 

3 

4 

l4o 

1 

1 

1 

6 

3 

l4l 

1 

1 

1 

4 

1 

2 

142 

1 

1 

2 

4 

2 

143 

1 

1 

2 

2 

2 

144 

1 

2 

2 

4 

3 

145 

1 

2 

3 

6 

5 

146 

1 

1 

2 

5 

3 

147 

1 

1 

2 

0 

4 

148 

1 

2 

3 

6 

3 

160 

2 

1 

1 

6 

4 

161 

2 

1 

2 

4 

5 

180 

2 

1 

1 

5 

4 

181 

2 

1 

2 

7 

6 

182 

2 

1 

2 

3 

3 

183 

2 

2 

3 

6 

5 

184 

2 

1 

1 

2 

4 

185 

2 

3 

1 

4 

2 

186 

2 

1 

3 

6 

4 

187 

2 

1 

4 

4 

5 

188 

2 

2 

3 

7  1 

4 

5 
4 

7 

7 

1 

6 
3 

3 

4 
1 

3 

6 

1 

2 

1 

2 

1 

1 

1 

3 

5 
1 
1 
2 
1 
1 
1 
1 

3 

2 

6 

3 

1 

1 

7 

5 

3 
1 

4 
2 
1 

3 

6 
1 
6 

3 

1 

7 

1 
1 

5 

2 


1 

1 

1 

3 
1 
1 
1 

4 
1 
2 
2 
2 
1 
2 
1 
1 
1 
1 
2 
6 
1 
2 
2 
1 
4 
2 
4 
1 
2 
1 
2 
2 
1 
1 
2 
1 
1 
1 
2 
2 
1 
6 

4 

5 
7 

3 

6 
2 

4 
6 
4 
7 


3 

7 

1 

6 

3 

3 

5 

6 
6 

1 
6 

5 

2 

5 

4 
2 
1 
2 
2 
4 

3 

4 

5 
3 

3 
2 
2 
2 

5 

4 

5 

5 
2 
1 

6 
4 

4 
3 
3 
3 

5 

6 

3 

6 

3 
1 

4 

3 

l 


3 

6 


2 
1 
1 
I  4 
1  1 
I  4 
2 
5 
3 
1 

3 

3 

1 

3 

4 
1 
1 
2 
2 
2 
3 

3 

4 

3 

3 
1 

4 


1 


3 

1 

4 
2 
1 
1 
4 

3 

2 

1 

2 


!  4 


2 

3 


1 

2 

3 

2 


63 

Table  19. 


116  258  175 


150  125 


189 


119 


Research  Personnel  (Data) - Ease  of  Use  Rating 


Totals  = 


f 


sub.no.  type 


100 

101 

102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 
116 
117 
118 

119 

120 
121 
122 

123 

124 

125 

126 

135 

136 

137 

138 

139 

140 

14 1 

142 

143 

144 

145 

146 

147 

148 
160 
161 
180 
181 
182 

183 

184 

185 

186 

187 

188 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

T 

1 

1 

1 

1 

2 

1 

1 

1 

1 

1 

1 

0 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 


M[l]  M[2]  M[3l  M[4]  [M5l  M[6] 


Ml7J  M [8 ] 


3 
2 
1 

4 
6 

4 
3 
7 
2 

3 

5 
2 

5 

6 

5 
7 

1 

7 

6 

7 

7 

7 

2 

4 
4 
6 
4 
1 
6 
1 
o 

4 

4 

5 

6 

4 

5 
7 
2 

5 

5 

3 

3 

4 

5 
5 

4 

5 
2 

3 

5 

2 


5 
3 

6 

3 
7 

4 

7 

3 

4 

5 

5 
7 

6 
6 
4 
4 
6 
4 
4 

7 

4 

3 
6 
6 
2 
6 

7 

6 

4 
4 

4 

5 

6 
2 
7 
7 

4 

5 
5 

5 

6 

5 

6 
5 
7 
7 
5 

5 
4 
2 

3 

6 


6 

1 

2 

4 
6 

7 

6 

6 

3 

7 

7 

2 

7 

2 

3 

5 

6 
7 
7 

5 

4 

6 

7 

4 

7 

7 

1 

6 

2 

2 

2 

4 

4 

5 
1 
1 

3 

4 
1 

3 

6 

4 
6 

4 

3 

6 

3 

1 

6 

5 
3 
7 


6 

3 

6 

3 

3 
5 
5 
5 
1 

4 

5 
5 

5 

4 

3 

7 

3 

6 

5 

6 
1 
6 
2 
2 

3 
5 

1 

4 

5 

4 

4 

3 

4 

5 
3 
5 
5 
7 

2 
2 

3 
5 

4 

4 

5 
3 

6 

3 
2 

4 
6 

4 


Totals 


222 


256  236  259 


227  229  182  212 


Table  20.  Research  Personnel  (Data)  Amount  of  Information  Ratings 


*• 


SUB.NO.  type 


200 

201 

202 

203 

205 

206 
207 

209 

210 
211 
212 
213 
213 

215 

216 

217 

218 
219 
220 
221 
222 
223 

224 

225 
226 
227 
228 
229 

230 

231 

232 

233 

234 

235 

240 

241 

242 
260 
261 
280 

281 

282 
283 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 


Totals  = 


M[l] 

1 

3 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

2 

1 

1 

1 

1 

1 

1 

2 

1 

1 

1 

1 

1 

2 

1 

1 

1 

1 

1 

1 

49 


M[2] 

1 

3 

2 

3 

1 

2 

2 

2 

1 

2 

2 

1 

2 

2 

3 
2 
2 
1 
6 

4 

2 

5 
2 
4 
3 
3 
3 
2 
2 
2 
2 

3 

2 

1 

1 

1 

3 

2 

1 

1 

2 

3 

4 

98 


M[3l 

6 

2 

7 

5 

5 

3 

6 

4 
6 

5 
5 
3 
5 
7 

3 

2 

7 

5 

4 

6 

4 

3 

6 

6 

7 

5 
5 
7 
7 

5 

6 

3 

4 

2 

7 

6 

6 

6 

4 

3 

6 

7 

7 

218 


M[4) 

2 

1 

4 

4 

6 

3 

4 

4 

5 
2 
2 
2 
2 
3 
3 
3 
5 
2 

7 

3 
5 
7 
2 

5 

4 

6 

5 
2 

6 
6 

4 

3 

6 

2 

3 

3 

5 

6 

5 

3 

4 

4 

5 

168 


M[5] 

4 

3 

1 

6 

2 

3 

3 

3 

3 
1 
2 
2 
2 
1 
2 

4 

7 

2 

3 

2 

5 

6 
6 
3 

3 
5 
2 
2 

4 
2 
3 

3 

4 
2 
1 
1 
2 

3 

2 

1 

3 

1 

4 

124 


m[6] 

2 

2 
4 
1 
1 
2 
1 
1 
1 
4 
2 
1 
2 
1 
1 
1 

3 
1 
2 
1 
1 
1 

3 

2. 

3 

4 

3 

1 

3 

3 
1 
1 
2 
1 
1 
1 
2 
6 

4 

3 

6 

7 

7 

100 


M[7] 

3 

4 
1 

7 

2 

2 

2 

2 

2 

2 

5 
2 
4 
2 

3 
3 
2 

3 

4 
4 

4 
2 
2 

5 

5 

6 

2 

5 

6 

5 

4 

4 

7 

2 

5 
3 
7 
7 
3 
2 

6 
6 
6 

163 


Mtf] 

2 

1 

2 

1 

2 

1 

1 

2 

2 

5 

1 

1 

2 

1 

1 

1 

1 

1 

3 

1 

1 

1 
1 

2 
2 
2 
2 
1 

3 
2 
1 
2 
2 
1 

4 
1 
1 
1 
1 
l 

4 

5 
3 

7 6 


Non  Research  Personnel  (Data) 
Ease  of  Use  Ratings 


Table  21 


Jfctffti 


SUB.NO.  TYPE  M[l]  M[2]  Ml3]  m[4]  m[53  m[6]  mC7]  m[8J 


200 

201 

202 

203 

204 

205 

206 
207 

209 

210 
211 
21 2 
213 

214 

215 

216 
217 
218 
219 
220 
221 
222 
223 

224 

225 
226 
227 
228 
229 
230 
231 
232 

233 

234 

235 

240 

241 

242 
260 
26l 
280 
281 
282 
283 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 


Totals  =  168  210  201  202  182  2l8  171  186 


Table  22.  Non  Research  Personnel  (Data) 
Amount  of  Information  Ratings 


EASE  OF  USE  RfiTINGS  (TCTAIS) 

(MEANS) 


1 

2 

3 

4 

5 

6 

7 

8 

63 

116 

258 

175 

150 

125 

189 

119 

49 

98 

218 

168 

124 

100 

163 

76 

1.212 

2.231 

4.962 

3.365 

2.885 

2.4o4 

3.635 

2.288 

1.140 

2.279 

5.070 

3.907 

2.884 

2.326 

3.791 

1.767 

1.562 

2.575 

1.655 

3.125 

2.732 

1.282 

1.224 

2.390 

2.410 

2.242 

2.778 

3.049 

1.155 

>53 

1.250 

1.605 

1.286 

2.044 

1.768 

1.653 

1.132 

.408 

1.107 

1.546 

1.552 

1.497 

I.667 

1.746 

1.075 

AMOUNT  OF  INFORMATION  RATINGS 


1  2 _ 3  4  5  6  _ 7  8 


222 

256 

236 

259 

227 

229 

182 

212 

168 

210 

201 

202 

182 

218 

171 

186 

4.269 

4.923 

4.53C 

4.981 

4.365 

4  >04 

3.500 

4.077 

3.818 

4.773 

4.568 

4.591 

4.136 

4.955 

3.886 

4.227 

3.235 

1.686 

2.056 

2.057 

4.155 

1.779 

2.365 

2.263 

3.649 

2.221 

3.245 

2.469 

3.027 

2.362 

2.783 

1.948 

1.799 

1.299 

1.434 

1.434 

2.038 

1.334 

1.538 

1.504 

1.910 

1.490 

1.801 

1.571 

1.740 

1.537 

1.668 

1.396 

NOTE:  R  =  Research,  NR  =  Nonresearch 


TOTAIS 

MEANS 

VARIANC 

ST. DEV 


TOTAL' 

MEANS 

VARIA' 

ST.DE 


Table  23.  Means,  Variance  and  Standard  Deviation 
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